On regression adjustments to experimental data

Regression adjustments are often made to experimental data. Since randomization does not justify the models, almost anything can happen. Here, we evaluate results using Neyman’s non-parametric model, where each subject has two potential responses, one if treated and the other if untreated. Only one of the two responses is observed. Regression estimates are generally biased, but the bias is small with large samples. Adjustment may improve precision, or make precision worse; standard errors computed according to usual procedures may overstate the precision, or understate, by quite large factors. Asymptotic expansions make these ideas more precise.